A Unified Arbitrary Style Transfer Framework via Adaptive Contrastive Learning

نویسندگان

چکیده

This work presents Unified Contrastive Arbitrary Style Transfer (UCAST), a novel style representation learning and transfer framework, that can fit in most existing arbitrary image models, such as CNN-based, ViT-based, flow-based methods. As the key component tasks, suitable is essential to achieve satisfactory results. Existing approaches based on deep neural networks typically use second-order statistics generate output. However, these hand-crafted features computed from single cannot leverage information sufficiently, which leads artifacts local distortions inconsistency. To address issues, we learn directly large number of images contrastive by considering relationships between specific styles holistic distribution. Specifically, present an adaptive scheme for introducing input-dependent temperature. Our framework consists three components: parallel transfer, domain enhancement module effective distribution, generative network transfer. Qualitative quantitative evaluations show results our approach are superior those obtained via state-of-the-art The code available at https://github.com/zyxElsa/CAST_pytorch.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Fast Patch-based Style Transfer of Arbitrary Style

Artistic style transfer is an image synthesis problem where the content of an image is reproduced with the style of another. Recent works show that a visually appealing style transfer can be achieved by using the hidden activations of a pretrained convolutional neural network. However, existing methods either apply (i) an optimization procedure that works for any style image but is very expensi...

متن کامل

Addressing Learning Style Criticism: The Unified Learning Style Model Revisited

Learning style is one of the individual differences that play an important but controversial role in the learning process. This paper aims at providing a critical analysis regarding learning styles and their use in technology enhanced learning. The identified criticism issues are addressed by reappraising the so called Unified Learning Style Model (ULSM). A detailed description of the ULSM comp...

متن کامل

Active manifold learning via a unified framework for manifold landmarking

The success of semi-supervised manifold learning is highly dependent on the quality of the labeled samples. Active manifold learning aims to select and label representative landmarks on a manifold from a given set of samples to improve semi-supervised manifold learning. In this paper, we propose a novel active manifold learning method based on a unified framework of manifold landmarking. In par...

متن کامل

A Unified Learning Framework: Multisets Modeling Learning

Abstract A unified learning framework is proposed. Its different special cases will automatically lead us to current existing major types of neural network learnings, e.g, data clustering, various PCAtype self-organizations and their localized extensions, self-organizing topological map, as well as supervised learning for feedforward network and modular architecture. Not only this new framework...

متن کامل

An unified framework for shot boundary detection via active learning

Video shot boundary detection is an important step in many video processing applications. We observe that video shot boundary is a multi-resolution edge phenomenon in the feature space. In this paper, we expanded our previous temporal multi-resolution analysis (TMRA) work by introducing the new feature vector based on motion. Further we employ the support vector machine (SVM) to refine the clas...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: ACM Transactions on Graphics

سال: 2023

ISSN: ['0730-0301', '1557-7368']

DOI: https://doi.org/10.1145/3605548